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Abstract 

This article describes the first implementation of the 
GADEL system : a Genetic Algorithm for Default 
Logic. The goal of GADEL is to compute extensions 
in Reiter's default logic. It accepts every kind of finite 
propositional default theories and is based on evolu- 
tionary principles of Genetic Algorithms. Its first ex- 
perimental results on certain instances of the problem 
show that this new approach of the problem can be 
successful. 



General Info 

The system works on SUN/Solaris or PC/Linux with 
Sicstus Prolog3.7.x and C. It is written in Prolog and 



E k+1 = Th(E k )U{ 7 \ a : gj, 

7 

a 6 E k ,->Pi <£E,Vi = l,...,n} 

then, E is an extension of (W,D) iff E = UfcLo-^- 
The computatio n of an exte nsion is known to be 
£2 — co mplete (Gottlob 1992[). Even if the system 
DeRes ( |Cholewiriski et al. 199£ ) has very good per- 
formance on certain classes of default theories, there is 
no efficient system for general extension calculus. The 
aim of the present work is to describe the first imple- 
mentation of the GADEL system (Genetic Algorithms 
for DEfault Logic) which applies Genetic Al gorithms 



it generates a Sicstus library in C. The current version Saubion, fc Stephan 2000|) 



principles to propositiona l default reasoning ( Nicolas 



is about 3UUU lines ot Frolog. 

Description of the System 
Default Logic and Genetic Algorithms 

Defa ult Logic has been introduced by Reiter (Reiter 



1980] ) in order to formalize common sense reasoning 



from incomplete information, and is now recognized as 
one of the most appropriate framework for non mono- 
tonic reasoning. In this formalism, knowledge is rep- 
resented by a default theory (W,D) where W is a set 
of first order formulas representing the sure knowledge, 
and D a set of default rules (or defaults). A default 
S = a i s an inference rule providing conclu- 

sions relying upon given, as well as absent information 
meaning "if the prerequisite a is proved, and if for all 
i = l,...,n each justification Pi is individually con- 
sistent (in other words if nothing proves its negation) 
then one concludes the consequent 7". From a default 
theory (W, D) one tries to build some extensions, that 
are maximal sets of plausible conclusions. Reiter has 
given the following pseudo iterative characterization of 
an extension E: we define 

• E = W 

• and for all k > 0, 



Based on the principle of natural selection, Genetic 
Algorithms have been quite successfully applied to com- 
binatorial problems such as scheduling or transporta- 
tion problems. The key principle of this approach states 
that, species evolve through adaptations to a changing 
environment and that the gained knowledge is embed- 
ded in the structure of the population and its members, 
encoded in their chromosomes. If individuals are con- 
sidered as potential solutions to a given problem, ap- 
plying a genetic algorithm consists in generating better 
and better individuals. A genetic algorithm consists of 
the following components: 

• a representation of the potential solutions in a chro- 
mosome, in most cases, a string of bits representing 
its genes, 

• an initial population, 

• an evaluation function which rates each potential so- 
lution w.r.t. the given problem, 

• genetic operators that define the composition of the 
offsprings : two different operators will be considered 
: crossover allows to generate two new chromosomes 
(the offsprings) by crossing two chromosomes of the 
current population (the parents), mutation arbitrar- 
ily alters one or more genes of a selected chromosome, 

• parameters : population size p S ize and probabilities 
of crossover p c and mutation p m . 



and an iteration process: 

• evaluate each chromosomes, 

• order the population according to evaluation rates 
and select the bests chromosomes, 

• perform crossover and mutation on pairs of randomly 
selected chromosomes, 

• repeat this full process until a user-defined number 
of populations has been explored. 

The best chromosome of each population w.r.t. the 
evaluation function represents the current best solution 
to the problem. 

Before a detail description of the GADEL system, it 
is necessary to give some arguments about the choice 
of the implementation language: 

• In the previous section we have presented the most 
common version of GA but in fact each part of the 
system can take various forms. To develop easily 
a GA system the implementation language must be 
very flexible and modular. 

• A GA system is an iterative system. The implemen- 
tation language must be efficient. 

• Default Logic is based on classical logic. To develop 
easily a GA system about Default Logic, the imple- 
mentation language must be logic and symbolic. 

From above, the choice of the implementation language 
is obvious: the most popular and efficient of the logic 
programming language, Prolog. We assume in the rest 
of the paper a minimal knowledge of Prolog. The article 
is organized as follows: section 2 presents the genetic 
algorithms aspects of GADEL, section 3 provides the 
process of compilation of a default theory to a prolog 
program, section 4 focuses on the evaluation function of 
GADEL and section 5 describes our experiments w.r.t. 
other existing systems. 

GADEL: a GA system 

Representation and semantics. Our purpose is to 
construct an extension of a given default theory (W, D) . 
For each default - : ft'----' 9 " W e encode in the chromo- 

7 

some the prerequisite a and all justifications f3i,...,(3 n 
conjointly. Given a set of defaults of size n the chromo- 
some will be of size 2n. A candidate extension CE{G) 
associated to a chromosome G is : 

CE{G) =Th(WU { T< I ~ t e fl L) 

I and G|2i-i = 1 and G\2i = J 

Population tree. According to the principles of Ge- 
netic Algorithms, we now consider a population of in- 
dividuals representing candidate extensions. Usually 
chromosomes are strings of bits and population are sets 
of chromosomes. We have chosen a new representation 
for the population: binary trees. A population is de- 
fined inductively on the set of constructors A, zero, one 
and zero — one of arity, respectively, 0, 1, 1, and 2. The 
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A A A 

Figure 1: Population {0101,1000,1010} 



two advantages of this representation are its compact- 
ness and unicity of each chromosome. 

For example, the population {0101,1000,1010} is 
represented by the tree in Figure 1. 

Compilation of default theory 

A default theory is the given of a set of (propositional) 
formulas W and a set of defaults D. Prerequisite, con- 
clusion and justifications of a default are all (proposi- 
tional) formulas. So the GADEL system needs a clas- 
sical theorem prover. It must be efficient because it is 
applied on each chromosome at each new population. 
The obvious choice is to compile all these sets of formu- 
las into a set of clauses. We have chosen the compilation 
to a disjunctive Prolog program. 

Small introduction to disjunctive logic program- 
ming. The theoretical basis of Prolog is the SLD- 
resolution for Horn clauses^. It is not possible to di- 
rectly insert disjunctive clauses in a Prolog program^. 
Disjunctive logic programming (resp. disjunctive Pro- 
log) is an "extension" of Horn logic programming (resp. 
Prolog) which allows disjunctions in the heads of def- 
initef] clauses (resp. Prolog clauses). A way to han- 
dle disjunctive clauses is the case-analysis principle: 
a set of clauses {C V C", C\, . . . , C m } is unsatisfiable 
if and only if the two sets of clauses {C, Ci, . . . , C m } 
and {C",Ci,... ,C m } are also unsatisfiable. Disjunc- 
tive clauses (hi V . .. V h p V ->bi V ... V -ib n ) (hk, 
1 < k < p and bk, 1 < k < n atoms) are then writ- 
ten (h\ V . . .V hp <— b\ A . . . A b n ). We have chosen 
the SLOU-resolution approach ( |Stephan 1998| ) (case- 
analysis and SLD-reduction) as the theoretical basis of 
SLOU Prolog, our implementation of disjunctive Pro- 

1 A Horn clause is a clause with at most one positive 
literal 

2 A clause is disjunctive if it contains at least two positive 
literals 

3 A clause is definite if it contains one and only one pos- 
itive literal 



log. 

The strategy of SLOU Prolog applies case-analysis by 
necessity: the case-analysis is used only when a head ft, 
of a disjunctive clause (hi V . . . V h p <— h\ A . . . A b n ) is 
useful in the proof. This strategy needs that a negative 
clause^ -161 V ... V ~^b n is written false <— bi A . . . A b n 
and false becomes the goal. This choice assumes that 
almost all the clauses are definite (Prolog) clauses. 

From set of defaults to disjunctive Prolog pro- 
gram. Let us give a default "'•^•••'^ , the i th of the 
default theory and a chromosome G. If G\n-i = 1 and 
G\%i — then the default is supposed to be applied and 
7 must be added to the candidate extension. Hence G 
has to be a parameter of the theorem prover. In or- 
der to calculate (CE(G) h a,) or (3j(CE(G) h -.#')), 
i and (i,j) also have to be parameters of the theorem 
prover. So a propositional variable h is compiled in a 
disjunctive Prolog atom h(I, G). We can now describe 
the compilation of the three parts of a default rule. 

• Compilation of a conclusion: In order to calculate 
CE(G), we must add 74 to the candidate extension if 
G\2i-i — 1 and G\2% = 0. We first normalize 7* in a 
set of disjunctive clauses {hi V. . . Wh p <— bi A. . . A& n } 
and compile it in a disjunctive Prolog definition: 

{hi(I, G); . . . ; h p (I, G) : - 
G?|a/-i = 1, G\ 2I = 0, 61 (I, G), . . . , b n (I, G)} 

• Compilation of a prerequisite: The function / of the 
GADEL evaluation function compares G|2i-i with 
CE(G) h a, (see section @). To prove it with a 
disjunctive logic program we prove CE(G),^ai h 
false. We first normalize -ictj in a set of clauses 
{hi V . . . V hp <— b\ A . . . A fe n } and compile it in a 
disjunctive Prolog definition: 

{hi(l, G); . . . ;/i p (J,G):- 
I = i,bi(I,G),... ,b n (I,G)} 

• Compilation of justifications: The function / of 
the GADEL evaluation function compares G\a with 
3j(CE(G) h — 1/3^ ) . To prove it with a disjunctive 
logic programs we prove (3j(CE(G),/3j h false)). 
We first normalize in a set of clauses {/11V. . .\/hp<— 
b\ A. . .Ab n },Vj, and compile it in a disjunctive Prolog 
definition: 

{h\(I, G); . . . ; h p (I, G) : - 
I=(i,j),h(I,G),... ,6„(I,G)} 

• Compilation of a formula we W: We first normalize 
w in a set of clauses {hi V . . . V h p <— bi A . . . A b n } 
and compile it in a disjunctive Prolog definition: 

{hi(I,G);... ;h p (I,G) : - 
h(I,G),... ,b n (I,G)} 

4 A clause is negative if it contains only negative literals 



From disjunctive Prolog to Prolog. During the 
execution of a disjunctive Prolog program, some clauses 
are dynamic: case-analysis creates from a disjunctive 
clause (hi V ... V hp <— b\ A ... A b n ) p new clauses 
(hi <— bi A ... A b n ) and {hk}i<k< P - A disjunctive 
clause is called usable if it has not been splitted in this 
set of clauses otherwise it is called unusable. A new 
clause is usable if it is the result of a case- analysis. To 
realize the case-analysis principle in Prolog, one needs 
to extend each predicate with a program continuation P 
(a difference list) that handles those dynamic clauses. 
A disjunctive Prolog clause (hi(I, G); . . . ;h p (I,G) : — 
bi(I, G), . . . , b n (I, G)) is then compiled in a set of Pro- 
log clauses as follows: 

hi(I,G,P):- 

usable_?(hi <— bi A . . . A b n , P), 
bi(I,G,P),... ,b n (I,G,P) 

1 

usable _l(hi V . . . V hp <- h A . . . A b n , P), 
unusable _\(hi V . . . V h p <— bi A . . . A b n , P), 
{ same_assumptions(P 1 Pi), 

usable _\(hu Pi), false(I, G, Pi), }i<i< p 
usable_\(hi <— bi A . . . A b n , P), 
h(I,G,P),... ,b n (I,G,P). 
{h k (I,G,P) : - 

usable _?(hk, P) 

1 

usable _l(hi V . . . V h p <— bi A . . . A b„, P), 
unusable _\(hi V . . . V h p *— bi A . . . A b n , P), 
{ same_assumptions(P, Pi), 

usable _\(h u Pi), false(I, G, Pi), }i<i< p ,i^k 
usable_\(h k <— b x A ... A b„, P).}i<fc< p 

Evaluation function of GADEL 



The evaluation function is the heart of the GADEL sys- 
tem. It rates each chromosome given a default theory 
compiled in a disjunctive prolog program. 
Evaluation of pair of genes. For a default 5{ — 

"''^''"'^ , an intermediate evaluation function f is 

defined in Table [|. Given the two positions G\2i-i and 
G\2i in the chromosome associated to the default 6i, 
the first point is to determine w.r.t. these values if this 
default is supposed to be involved in the construction 
of the candidate extension and then to check if this 
application is relevant. 

We only illustrate f on the case G|2i-i = 1 and 
G\2i — of the Table |l| (with penalty P2 and a default 
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Table 1: Evaluation 



with only one justification): 



f(P , (C, Eval_Gsi), (G, Eval_G>i)) 



G\2i-i — 1, G\2i — 0, 

false(I, G, _P), %%(CE(G) h a t ) = true 
false((I, 1), G, _P), %%(CE(G) h -.ft) = true 
Eval _G>i is Eval _Gyi + P2- 

Evaluation of chromosome and population. The 

evaluation of a chromosome is the total sum of the eval- 
uations for each pair of genes. Our evaluation func- 
tion is calculated directly over the population tree by 
a depth-first traversal. The result is a set of pairs of a 
chromosome and its evaluation. During the traversal, 
the construction of the current evaluated chromosome 
is prefixed and the evaluation of the genes is postfixed. 

evaluation(Current _Pop, Evaluated _P op) : — 

eval_alpha(0, 0, Current _Pop, Evaluated _P op). 

eval _alpha(I , G, one(Subtree), Evaluations) : — 
G\2I-1 = 1, 

eval _beta(I , G, Subtree, Evaluations) . 

eval _beta{I, G, zero(Subtree), Evaluations') : — 
G| 2 z = 0, 
I' isl + l, 

eval _alpha(l' , G, Subtree, Evaluations), 
map(f, I, Evaluations, Evaluations'). 

Applying the System 
Methodology 

Methodology for using GADEL is the same as using de- 
fault logic as a framework for knowldege representation. 



Specifics 

The semantics of our system is the Reiter's preposi- 
tional default logic. 

Users and Useability 

The GADEL system takes default theory as Prolog facts 
in an input file. Classical formulas of default theory are 
arbitrary formulas with conjunctions, disjunctions and 
negations (noted resp. &&, || and !). A default is a 
triplet composed of a prerequisite, a list of justifica- 
tions and a conclusion. GADEL is a framework for non 
monotonic reasoning systems. To extend GADEL to 
an other system, one needs to redefine the evaluation 
function. 

Evaluating the System 
Benchmarks 

We define two kinds of benchmarks: a taxonomic de- 
fault theory u people" described in Table 2 and the well 
known Hamiltonian cycle problem in Table 5 as it 



has b een described and encoded in (Cholewihski et 



1999) 



Comparison 

DeRes and GADEL are compared on our two kinds of 
benchmarks. CPU times given are in seconds on a SUN 
E3000 (2 x 250Mhz). The parameters of the genetic 
algorithm are p c = 0.8 and p m = 0.1. 

GADEL:l/DeRes:0. Table 3 gives results about 
the people default theory. Each line corresponds to 
the common part of W pe0 pie augmented with one of the 
specified formula of the first column. The second col- 
umn gives p S i Z e the initial number of chromosomes in 
the population, the third one is the average number of 
populations needed to find an extension. The last two 
columns give CPU times. ( |Cholewihski et al. 199S ) de- 
scribes the very good performances of DeRes on some 
kind of default theories: the stratified ones. But it is 
also noticed that for a non stratified default theory the 
performance of DeRes are not enough to deal with a 
non very few number of defaults. Results given in this 
table shows that DeRes has a lot of difficulties with our 
taxonomic people example (even if the local prover is 
used). Conversely the number of populations are quite 
small for GADEL (even if the time is not so good: all 
the implementation is written in Prolog). 

Table 4 gives results about W peop i e U {man} with dif- 
ferent sizes of populations (200 tests for each size of pop- 
ulation). The second line gives p S i ze the initial number 
of chromosomes in the population. The third one gives 
the time spent for one complete computation of a new 
population. The fourth one gives the average number of 
populations needed to find an extension. The last one 
gives the average time to find an extension. These re- 
sults demonstrate that the size of the population must 
be balanced by the time spent for one complete com- 
putation of a new population. The increase of the pop- 
ulation size does not necessarily increase the efficiency 



-iboy V -igirl, 
-•girl V kid, 
-•kid V human, 
^adult V human, 
-^adult V -^male V man, 
-^academic V adult, 
-^doctor V academic, 
-iprof V academic, 
-^cardinal V bishop, 
-^whitesuit V suit, 
-^redsuit V -^whitesuit, 
-^redsuit V -^blacksuit 
U{boy}or U {giHj-or U {man}; 
or U {woman, student} 



•boy V fcid, 

-human V maZe V female, 
^student V human, 
-•adult V — ifcicZ, 

iadult V -i female V woman, 
^academic V diploma, 
spriest V academic, 
•bishop V priest, 
iredsuit V suit, 
Macksuit V suit, 
iwhitesuit V -^blacksuit, 



■ U {woman} U {man, student} 



D 



people 

human : name 



adult 
student : -^married 

—imarried 
adult : —istudent 

employed 
adult : car 

car 
man : —iprof 

beer 
man : cof f ee 

coffee 
Iranian : tea 
tea 

academic : —>priest 
toys 

academic : glasses 

glasses 
doctor : medic i ne 

medicine 
prof : employed 

employed 
prof : tie. 
tie 

prof : conservative 



kid : toys 
toys 

student : —i employed 

—•employed 
student : sports 

sports 
adult : —i student ,—ipriest 

married 
adult : — ^academic 

—>toys 
man : — 'vegetarian 

steak 
manVwoman : wine 

wine 
academic : —iprof 

— 'employed 
academic : books 

books 
academic : —ipriest 
late 

doctor : white suit 

whitesuit 
prof : grey 

grey 
prof : wa I. er 

water 
priest : male 



male 
priest : —-eg rd-i n a I 



redsuit 
tie : suit 



suit 



sports : man 



f ootballVrugbyVtennis 
toysA(footballVrugby) : ball 
ball 

toys : girl 
doll 



mobile 

■r , ;.'< i A \c.oj j (.(■ : -^sports 

heartdisease 
sports : woman 

swimV joggingV tennis 

toys : boy 

weapon 
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Psize = 
N(N+1) 
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CPU time 
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nnmilatirtTi s 


CPU time 


15 


120 


2.6 


6.6 


17.2 


16 


136 


2.8 


6.9 


19.7 


17 


153 


3.4 


4.9 


17.0 


18 


171 


3.8 


5.0 


19.0 


19 


190 


4.2 


5.0 


21.2 


20 


210 


4.7 


4.5 


21.3 


21 


231 


4.9 


4.8 


23.8 


22 


253 


5.6 


3.9 


22.1 


23 


276 


5.8 


4.7 


27.1 


24 


300 


6.0 


5.0 


30.3 


25 


325 


7.2 


3.5 


25.3 



Table 4: W pe0 pie U {man} 



Table 2: The taxonomic problem : "people" 
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ham.b 3,2,0,0,1,0,0 


465 


1.8 


5.6 


0.5 


ham.b 4,2,0,0,1,0,0 


465 




>7200 


19.4 


ham.b 5,2,0,0,1,0,0 


465 




>7200 


566.4 


ham.b 6,2,0,0,1,0,0 


465 




>7200 


>7200 



Table 5: GADEL: l/DeRes:l 



of the genetic algorithm. Finally, Figure 2 presents for 
WpeopieU {man} with N = 17 the number of tests w.r.t. 
the number of populations needed to obtain an exten- 
sion. This figure suggests to stop computation after 6 
populations and to restart with a brand new one since 
80% of tests end after 6 populations at most. 
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boy 


325 


3.3 


15.4 


>7200 


girl 


325 


3.4 


15.6 


>7200 


man 


325 


3.5 


25.3 


>7200 


woman 


325 


3.0 


14.6 


>7200 


man A student 


325 


186.7 


467.5 


>7200 


woman A student 


325 


271.6 


704.4 


>7200 



Table 3: GADEL:l/DeRes:0 



Figure 2: W peop i e U {man} with N = 17 (p S ize = 153) 



GADEL:1/Deres:l. GADEL has poor perfor- 
mances on Hamiltonian problems. We think that it 
is be cause we do no t take into account the grounded- 
ness ( Schwind 1990| ) into our evaluation function. As a 
matter of fact, in the Hamiltonian problem, a solution 
is exactly one "chain"0of defaults, but, there is a lot of 
potential solutions (whose evaluation is null) based on 
two, or more, chains of defaults. The only criterion to 



5 We say that 8 is chained to 8' if the prerequisite of 8' is 
deducible from W and the consequent of 8. 



discard these candidate extensions is the groundedness 
property that they do not satisfy. Conversely, in people 
example, a solution is a set of non conflicting defaults, 
but at most four defaults are chained together, and so 
the groundedness property is less important to reach 
a solution. We are now testing some new evaluation 
functions in order to take into account this criterion. 

Other systems. We have also in mind that in the 
area of logic programming and non mon otonic reason- 



ing there ex ist othe rs systems (Smod els ( Niemela fc Si 



mor js 1997| ), DLV flEiter et al. 1998[ )) able to compute 
stable models of extended logic program. Since this 
task is equivalent to compute an extension of a default 
theory it seems interesting to compare GADEL to these 
systems. But, even if DLV has the advantage to accept 
formulas with variables which are instantiated before 
computation, this system does not accept theories like 
our people example. On its part, Smodels does not deal 
with this default theory because it can not be repre- 
sented by a normal logic program without disjunction. 
Because we have the objective to deal with every kind 
of propositional formulas, GADEL spends a lot of time 
in theorem proving and it seems not realistic to com- 
pare it with those two systems. But it will be very 
inter- resting to work on GADEL 's architecture in order 
to improve its performances on particular subclasses of 
default theories. 

Problem Size 

The system is a prototype which can handle non strat- 
ified theories with about one hundred defaults. 
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Conclusion 

In this paper, we have described the first implementa- 
tion of our system GADEL whose goal is to compute 
extensions of every kind of finite propositional Reiter's 
default theories. Our new approach, using principles 
of genetic algorithms, seems to be relevant as it is il- 
lustrated by our experimental results. But this present 
work is a first approach and we have in mind many im- 
provements as : more accurate definition of the evalua- 
tion function, using reparation techniques, local search 
heuristics. 
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